BioNLP'09 Shared Task on
Event Extraction
in conjunction with
BioNLP, a NAACL-HLT 2009
workshop, June 4-5 2009, Boulder, Colorado
Final Evaluation Results
on Phosphorylation events by Approx. Span matching
Task 1
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[JULIELab ] Phosphorylation 135 ( 103) 113 ( 103) 76.30 91.15 83.06
[ConcordU ] Phosphorylation 135 ( 94) 98 ( 94) 69.63 95.92 80.69
[UT+DBCLS ] Phosphorylation 135 ( 106) 137 ( 106) 78.52 77.37 77.94
[ UTurku ] Phosphorylation 135 ( 109) 146 ( 109) 80.74 74.66 77.58
[ UZurich ] Phosphorylation 135 ( 81) 84 ( 81) 60.00 96.43 73.97
[VIBGhent ] Phosphorylation 135 ( 76) 85 ( 76) 56.30 89.41 69.09
[ UNSW ] Phosphorylation 135 ( 85) 119 ( 85) 62.96 71.43 66.93
[ UMich ] Phosphorylation 135 ( 100) 166 ( 100) 74.07 60.24 66.45
[ASU+HU+BU] Phosphorylation 135 ( 74) 88 ( 74) 54.81 84.09 66.37
[ SCAI ] Phosphorylation 135 ( 69) 80 ( 69) 51.11 86.25 64.19
[ UNIMAN ] Phosphorylation 135 ( 106) 197 ( 106) 78.52 53.81 63.86
[CNBMadrid] Phosphorylation 135 ( 81) 123 ( 81) 60.00 65.85 62.79
[ UAveiro ] Phosphorylation 135 ( 67) 84 ( 67) 49.63 79.76 61.19
[ Cam ] Phosphorylation 135 ( 67) 86 ( 67) 49.63 77.91 60.63
[CIPS-ASU ] Phosphorylation 135 ( 72) 107 ( 72) 53.33 67.29 59.50
[ UTokyo ] Phosphorylation 135 ( 60) 72 ( 60) 44.44 83.33 57.97
[ USzeged ] Phosphorylation 135 ( 109) 274 ( 109) 80.74 39.78 53.30
[ NICTA ] Phosphorylation 135 ( 61) 95 ( 61) 45.19 64.21 53.04
[ Team 24 ] Phosphorylation 135 ( 60) 95 ( 60) 44.44 63.16 52.17
[ PIKB ] Phosphorylation 135 ( 48) 53 ( 48) 35.56 90.57 51.06
[ KoreaU ] Phosphorylation 135 ( 44) 59 ( 44) 32.59 74.58 45.36
[UAntwerp ] Phosphorylation 135 ( 38) 56 ( 38) 28.15 67.86 39.79
[CCP-BTMG ] Phosphorylation 135 ( 30) 30 ( 30) 22.22 100.00 36.36
[ Team 09 ] Phosphorylation 135 ( 15) 20 ( 15) 11.11 75.00 19.35
Task 2
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------
[UT+DBCLS ] Phosphorylation 139 ( 96) 137 ( 96) 69.06 70.07 69.57
[CNBMadrid] Phosphorylation 139 ( 69) 123 ( 69) 49.64 56.10 52.67
[ Team 24 ] Phosphorylation 139 ( 55) 119 ( 55) 39.57 46.22 42.64
[CCP-BTMG ] Phosphorylation 139 ( 28) 30 ( 28) 20.14 93.33 33.14
[ASU+HU+BU] Phosphorylation 139 ( 31) 88 ( 31) 22.30 35.23 27.31
[UAntwerp ] Phosphorylation 139 ( 22) 56 ( 22) 15.83 39.29 22.56
Task 3
------------------------------------------------------------------------------------------------
TEAM gold (match) answer (match) recall prec. fscore
------------------------------------------------------------------------------------------------